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DETAILED ACTION 

Remarks 

1 . Receipt of Applicant's Amendment, filed on 08/1 2/2008, is acknowledged. 
The amendment includes the cancellation of claims 10, 26-28, and 33. The 
examiner further wishes to state that foreign priority of 09/1 9/2002 is accepted in 
the instant application. 

The examiner further wishes to state that there are several published 
patent applications (PGPUB) with different inventive entities which contain 
substantial similarities in drawings and specifications with the instant application 
(See Trepress et al. and Thorpe cited published patent applications). 

Priority 

2. Receipt is acknowledged of papers submitted under 35 U.S.C. 1 19(a)-(d), 
which papers have been placed of record in the file. 

Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for 
all obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically 
disclosed or described as set forth in section 102 of this title, if the differences 
between the subject matter sought to be patented and the prior art are such 
that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said 
subject matter pertains. Patentability shall not be negatived by the manner in 
which the invention was made. 

4. Claims 1-7, 9-1 1 , 14-25, 29-32, and 34 are rejected under 35 U.S.C. 
103(a) as being unpatentable over Kohonen et al. (Article entitled "Self 
Organization of a Massive Document Collection") in view of Derthick (Article 
entitled "Interfaces for Palmtop Image Search") and in view of Schultz et al. 
(U.S. PGPUB 2003/0061211). 

5. Regarding claim 1 , Kohonen teaches a video processing apparatus 
comprising: 
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A) a memory configured to store a set of distinct information items (Page 575, 
Section B, Figures 5-6); and 

B) an information retrieval system configured to map the set of distinct 
information items to respective nodes in an array of nodes by mutual similarity of 
the information items, so that similar information items map to nodes at similar 
positions in the array of nodes (Page 574, Figures 5-6), the information retrieval 
system includes: 

C) a user control configured to define a first search criterion for selecting 
information items (Page 584, Figure 6); 

E) a detector configured to detect positions of nodes within the array of nodes, to 
which the selected information items have been mapped (Page 584, Figures 1, 
4-6); and 

F) a graphical user interface configured to display display points within a display 
area on a user display (Page 584, Figures 5-6); 

G) by grouping the display points in accordance with the positions of the nodes 
to which the selected information items have been mapped (Page 584, Figures 1, 
4-6). 

The examiner notes that Kohonen teaches "a memory configured to 
store a set of distinct information items" as "develop the final software for our 
method" (Page 575, Section B) and "our system operate in real time and fit 
medium-sized computers" (Page 575, Section B). The examiner further notes 
that Kohonen teaches "an information retrieval system configured to map 
the set of distinct information items to respective nodes in an array of 
nodes by mutual similarity of the information items, so that similar 
information items map to nodes at similar positions in the array of nodes" 
as "documents are presented as points on a two-dimensional (2-D) plane and the 
geometric relations of the image points of the documents represent their 
similarity relations" (Page 574). The examiner further notes that Kohonen 
teaches "a user control configured to define a first search criterion for 
selecting information items" as "keyword search" (Page 584). The examiner 
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further notes that Figure 6 describes an interface which displays retrieved search 
results based on the search constraint. The examiner further notes that 
Kohonen teaches "a detector configured to detect positions of nodes within 
the array of nodes, to which the selected information items have been 
mapped" as "Select labels automatically to characterize map regions" (Figure 1, 
Step 3). The examiner further notes that the retrieved results depicted in Figures 
5 and 6 clearly show positions of nodes retrieved from a query, and located in a 
defined region within the 2d map. The examiner further wishes to state that 
Figure 4 clearly shows the information items mapped to respective regions 
designated by different categories (see Chemistry and Building). The examiner 
further notes that Kohonen teaches "a graphical user interface configured to 
display display points which are at positions within a display area on a 
user display" as the retrieved results depicted in Figure 6. The examiner further 
notes that Kohonen teaches "by grouping the display points in accordance 
with the positions of the nodes to which the selected information items 
have been mapped" as "Select labels automatically to characterize map 
regions" (Figure 1 , Step 3). The examiner further notes that the retrieved results 
depicted in Figures 5 and 6 clearly show positions of nodes retrieved from a 
query, and located in a defined region within the 2d map. The examiner further 
wishes to state that Figure 4 clearly shows the information items mapped to 
respective regions designated by different categories (see Chemistry and 
Building). 

Kohonen does not explicitly teach: 
A) related to contents of items of video material; 

H) the graphical user interface further configured to display in a sequence in 
time a plurality of representations of the selected information items. 

Derthick, however, teaches "related to contents of items of video 
material" as "video retrieval, our current interfaces segment video into shots, 
and represent them with single frames" (Page 1, Section 1, Figure 1) and "the 
graphical user interface also displaying in a sequence in time a plurality of 
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representations of the selected information items" as "RSVP slideshow" 
(Page 1 , Section 2) and Figure 1 . 

The examiner notes that Figure 1 depicts an RSVP image show on an 
graphical user interface. 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because 
teaching Derthick's would have allowed Kohonen's to provide a method for 
having an efficient multiple image/multimedia retrieval based on RSVP premises, 
as noted by Derthick (Abstract). 

Kohonen and Derthick do not explicitly teach: 
D) and a second search criterion, the second search criterion defining a subset 
of the array of nodes such that only information items that meet the first search 
criterion and are located in the subset of the array of nodes defined by the 
second search criterion are selected. 

Schultz, however, teaches "and a second search criterion, the second 
search criterion defining a subset of the array of nodes such that only 
information items that meet the first search criterion and are located in the 
subset of the array of nodes defined by the second search criterion are 
selected" as "According to another aspect of the invention, geographically 
defined user queries may be composed by the client using textual information 
and/or spatial search information. Spatial search information may be selected, 
e.g., by the user highlighting a desired point or area on a displayed map. A 
combination search including text and spatial information may also be used" 
(Paragraph 13). 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because 
teaching Schultz's would have allowed Kohonen's and Derhtick's to provide 
more specific results for search engines via user-defined parameters, as noted 
by Schultz (Paragraph 8). 
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Regarding claim 2, Kohonen further teaches a video processing 
apparatus comprising: 

A) wherein the graphical user interface is operable to display a two-dimensional 
display array of said display points (Page 574, Figures 5-6). 

The examiner notes that Kohonen teaches "wherein the graphical user 
interface is operable to display a two-dimensional display array of said 
display points" as "documents are presented as points on a two-dimensional 
(2-D) plane and the geometric relations of the image points of the documents 
represent their similarity relations" (Page 574). 

Regarding claim 3, Kohonen further teaches a video processing 
apparatus comprising: 

A) wherein the information retrieval system is further configured to add a dither 
component so that substantially identical information items tend to map to closely 
spaced but different positions in the array (Page 584, Figures 5-6). 

The examiner notes that the Figure 6 of Kohonen depicts very similar 
topics closely coupled together in the large grid. 

Regarding claim 4, Kohonen further teaches a video processing 
apparatus comprising: 

A) wherein the information retrieval systems maps the information items to the 
respective nodes in the array of nodes on the basis of a feature vector derived 
from each information item (Page 574, Abstract). 

The examiner notes that Kohonen teaches "wherein the information 
retrieval systems maps the information items to the respective nodes in the 
array of nodes on the basis of a feature vector derived from each 
information item" as "the feature vectors for the documents statistical 
representations of their vocabularies are used" (Page 574, Abstract) and "Any of 
the basic projection methods can be used to organize textual data items, such as 
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documents, if their contents are described statistically as some kind of metric 
feature vectors" (Page 574, Section B). 

Regarding claim 5, Kohonen further teaches a video processing 
apparatus comprising: 

A) wherein which the feature vector for an information item represents a set of 
frequencies of occurrence, within that information item, of each of a group of 
information features (Pages 576, 581). 

The examiner notes that Kohonen teaches "wherein which the feature 
vector for an information item represents a set of frequencies of 
occurrence, within that information item, of each of a group of information 
features" as "in the basic vector-space model [38] the stored documents are 
represented as real vectors in which each component corresponds to the 
frequency of occurrence of a particular word in the document" (Page 576, 
Section A). 

Regarding claim 6, Kohonen further teaches a video processing 
apparatus comprising: 

A) wherein the information items comprise textual information, the feature vector 
for an information item represents a set of frequencies of occurrence, within that 
information item, of each of a group of words (Pages 576, 581 ). 

The examiner notes that Kohonen teaches "wherein the information 
items comprise textual information, the feature vector for an information 
item represents a set of frequencies of occurrence, within that information 
item, of each of a group of words" as "in the basic vector-space model [38] the 
stored documents are represented as real vectors in which each component 
corresponds to the frequency of occurrence of a particular word in the document" 
(Page 576, Section A). 
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Regarding claim 7, Kohonen further teaches a video processing 
apparatus comprising: 

A) wherein the information items comprise textual information, and the 
information retrieval systems maps the information items to the respective nodes 
by mutual similarity of at least a part of the textual information (Page 575). 

The examiner notes that Kohonen teaches "wherein the information 
items comprise textual information, and the information retrieval systems 
maps the information items to the respective nodes by mutual similarity of 
at least a part of the textual information" as "The models are produced by a 
learning process that automatically orders them on the 2-D grid along with their 
mutual similarity" (Page 575, Section II). 

Regarding claim 9, Kohonen further teaches a video processing 
apparatus comprising: 

A) wherein the information items are pre-processed for mapping by excluding 
words occurring with less than a threshold frequency amongst the set of 
information items (Page 581 ). 

The examiner notes that Kohonen teaches "wherein the information 
items are pre-processed for mapping by excluding words occurring with 
less than a threshold frequency amongst the set of information items" as 
"The words occurring less than 50 times in the whole corpus, as well as set of 
common words in a stopword list of 1335 words were removed" (Page 581 , 
Section A). 

Regarding claim 1 1 , Kohonen does not explicitly teach a video 
processing apparatus comprising: 

A) wherein the sequence in time is a serial visual presentation of the said 
representations. 
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Derthick, however, teaches "wherein the sequence in time is a serial 
visual presentation of the said representations" as "Rapid Serial Visual 
Presentation" (Page 1 , Abstract) and Figure 1 . 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because 
teaching Derthick's would have allowed Kohonen's to provide a method for 
having an efficient multiple image/multimedia retrieval based on RSVP premises, 
as noted by Derthick (Abstract). 

Regarding claim 14, Kohonen does not explicitly teach a video 
processing apparatus comprising: 

A) wherein the graphical user interface displays a plurality of streams of 
representations at the same time in respective display zones. 

Derthick, however, teaches "wherein the graphical user interface 
displays a plurality of streams of representations at the same time in 
respective display zones" as "Rapid Serial Visual Presentation" (Page 1 , 
Abstract), "large image grid was continuously visible for SD" (Page 1 , Section 2) 
and Figure 1. 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because 
teaching Derthick's would have allowed Kohonen's to provide a method for 
having an efficient multiple image/multimedia retrieval based on RSVP premises, 
as noted by Derthick (Abstract). 

Regarding claim 15, Kohonen does not explicitly teach a video 
processing apparatus comprising: 

A) wherein the user control is further configured to select a representation from 
the plurality of representations, and the graphical user interface is further 
configured to display information related to the selected representation. 
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Derthick, however, teaches "wherein the user control is further 
configured to select a representation from the plurality of representations, 
and the graphical user interface is further configured to display information 
related to the selected representation" as "Rapid Serial Visual Presentation" 
(Page 1 , Abstract), "large image grid was continuously visible for SD" (Page 1 , 
Section 2) and Figure 1 . 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because 
teaching Derthick's would have allowed Kohonen's to provide a method for 
having an efficient multiple image/multimedia retrieval based on RSVP premises, 
as noted by Derthick (Abstract). 

Regarding claim 16, Kohonen does not explicitly teach a video 
processing apparatus comprising: 
A) wherein said representations comprise images. 

Derthick, however, teaches "wherein said representations comprise 
images" as "query image" (Page 1 .Section 2, Figure 1). 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because 
teaching Derthick's would have allowed Kohonen's to provide a method for 
having an efficient multiple image/multimedia retrieval based on RSVP premises, 
as noted by Derthick (Abstract). 

Regarding claim 17, Kohonen does not explicitly teach a video 
processing apparatus comprising: 
A) where said representations comprise text. 

Derthick, however, teaches "where said representations comprise 
text" as "query text" (Page 1, Section 2, Figure 1). 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because 
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teaching Derthick's would have allowed Kohonen's to provide a method for 
having an efficient multiple image/multimedia and text retrieval based on RSVP 
premises, as noted by Derthick (Abstract). 

Regarding claim 18, Kohonen further teaches a video processing 
apparatus comprising: 

A) wherein said representations comprise links to the information items 
represented thereby (Page 583, Figures 5-6). 

The examiner notes that Kohonen teaches "wherein said 
representations comprise links to the information items represented 
thereby" as "clicking a point on the map display with a mouse, links to the 
document database, enable reading the contents of the documents" (Page 583, 
Figures 5-6). 

The examiner notes that "clicking a point on the map display with a 
mouse, links to the document database, enable reading the contents of the 
documents" (Page 583, Figures 5-6) is analogous to "wherein the said 
representation comprises links to the information items represented 
thereby". 

Regarding claim 19, Kohonen does not explicitly teach a video 
processing apparatus comprising: 

A) A portable data processing device comprising a video processing apparatus 
according to claim 1 . 

Derthick, however, teaches "A portable data processing device 
comprising a video processing apparatus according to claim 1" as 

"palmtop interfaces" (Page 1, Section 2, Figure 1) and "video retrieval, our 
current interfaces segment video into shots, and represent them with single 
frames" (Page 1, Section 1, Figure 1). 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because 
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teaching Derthick's would have allowed Kohonen's to provide a method for 
having an efficient multiple image/multimedia retrieval based on RSVP premises, 
as noted by Derthick (Abstract). 

Regarding claim 20, Kohonen does not explicitly teach a video 
processing apparatus comprising: 

A) Video acquisition and/or processing apparatus comprising a video processing 
apparatus according to claim 1 . 

Derthick, however, teaches "Video acquisition and/or processing 
apparatus comprising a video processing apparatus according to claim 1" 

as "video retrieval, our current interfaces segment video into shots, and 
represent them with single frames" (Page 1 , Section 1 , Figure 1). 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because 
teaching Derthick's would have allowed Kohonen's to provide a method for 
having an efficient multiple image/multimedia retrieval based on RSVP premises, 
as noted by Derthick (Abstract). 

Regarding claim 21 , Kohonen teaches a method comprising: 

A) in which a set of distinct information items are mapped to respective nodes in 
an array of nodes by mutual similarity of the information items, so that similar 
information items map to nodes at similar positions in the array of nodes (Page 
574, Figures 5-6); 

B) defining a first search criterion for selecting information items (Page 584, 
Figures 5-6); 

D) detecting positions of nodes, within the array of nodes to which the selected 
information items have been mapped (Page 584, Figures 1 , 4-6); 

E) displaying display points within a display area on a user display (Page 584, 
Figures 5-6); 
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F) by grouping the display points in accordance with the positions of the nodes 
to which the selected information items have been mapped (Page 584, Figures 1 , 
4-6). 

The examiner notes that Kohonen teaches "in which a set of distinct 
information items are mapped to respective nodes in an array of nodes by 
mutual similarity of the information items, so that similar information items 
map to nodes at similar positions in the array of nodes" as "documents are 
presented as points on a two-dimensional (2-D) plane and the geometric 
relations of the image points of the documents represent their similarity relations" 
(Page 574). The examiner further notes that Kohonen teaches "defining a first 
search criterion for selecting information items" as "keyword search" (Page 
584). The examiner further notes that Figure 6 describes an interface which 
displays retrieved search results based on the search constraint. The examiner 
further notes that Kohonen teaches "a detector configured to detect 
positions of nodes within the array of nodes, to which the selected 
information items have been mapped" as "Select labels automatically to 
characterize map regions" (Figure 1 , Step 3). The examiner further notes that 
the retrieved results depicted in Figures 5 and 6 clearly show positions of nodes 
retrieved from a query, and located in a defined region within the 2d map. The 
examiner further wishes to state that Figure 4 clearly shows the information items 
mapped to respective regions designated by different categories (see Chemistry 
and Building). The examiner further notes that Kohonen teaches "displaying 
display points which are at positions within a display area on a user 
display corresponding to the selected information items" as the retrieved 
results depicted in Figure 6. The examiner further notes that Kohonen teaches 
"by grouping the display points in accordance with the positions of the 
nodes to which the selected information items have been mapped" as 
"Select labels automatically to characterize map regions" (Figure 1, Step 3). The 
examiner further notes that the retrieved results depicted in Figures 5 and 6 
clearly show positions of nodes retrieved from a query, and located in a defined 



Application/Control Number: 10/720,787 
Art Unit: 2168 



Page 



region within the 2d map. The examiner further wishes to state that Figure 4 
clearly shows the information items mapped to respective regions designated by 
different categories (see Chemistry and Building). 

Kohonen does not explicitly teach: 
A) related to contents of items of video material 

G) displaying in a sequence in time a plurality of representations of the selected 
information items. 

Derthick, however, teaches "related to contents of items of video 
material" as "video retrieval, our current interfaces segment video into shots, 
and represent them with single frames" (Page 1 .Section 1 , Figure 1 ) and 
"displaying in a sequence in time a plurality of representations of the 
selected information items" as "RSVP slideshow" (Page 1, Section 2) and 
Figure 1. 

The examiner notes that Figure 1 depicts an RSVP image show on an 
graphical user interface. 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because 
teaching Derthick's would have allowed Kohonen's to provide a method for 
having an efficient multiple image/multimedia retrieval based on RSVP premises, 
as noted by Derthick (Abstract). 

Kohonen and Derthick do not explicitly teach: 
C) and a second search criterion, the second search criterion defining a subset 
of the array of nodes such that only information items that meet the first search 
criterion and are located in the subset of the array of nodes defined by the 
second search criterion are selected. 

Schultz, however, teaches "and a second search criterion, the second 
search criterion defining a subset of the array of nodes such that only 
information items that meet the first search criterion and are located in the 
subset of the array of nodes defined by the second search criterion are 
selected" as "According to another aspect of the invention, geographically 
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defined user queries may be composed by the client using textual information 
and/or spatial search information. Spatial search information may be selected, 
e.g., by the user highlighting a desired point or area on a displayed map. A 
combination search including text and spatial information may also be used" 
(Paragraph 13). 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because 
teaching Schultz's would have allowed Kohonen's and Derhtick's to provide 
more specific results for search engines via user-defined parameters, as noted 
by Schultz (Paragraph 8). 

Regarding claim 22, Kohonen further teaches a method comprising: 
A) wherein the step of displaying displays a two-dimensional display array of 
said display points (Page 574, Figures 5-6). 

The examiner notes that Kohonen teaches "wherein the step of 
displaying displays a two-dimensional display array of said display points" 
as "documents are presented as points on a two-dimensional (2-D) plane and the 
geometric relations of the image points of the documents represent their 
similarity relations" (Page 574). 

Regarding claim 23, Kohonen does not explicitly teach a method 
comprising: 

A) wherein the sequence in time is a serial visual presentation of the 
representations. 

Derthick, however, teaches "wherein the sequence in time is a serial 
visual presentation of the representations" as "Rapid Serial Visual 
Presentation" (Page 1 , Abstract) and Figure 1 . 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because 
teaching Derthick's would have allowed Kohonen's to provide a method for 
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having an efficient multiple image/multimedia retrieval based on RSVP premises, 
as noted by Derthick (Abstract). 

Regarding claim 24, Kohonen further teaches a method comprising: 
A) selecting a representation from the plurality of representations, and displaying 
information related to the selected representation (Page 584, Figures 5-6). 

Regarding claim 25, Kohonen further teaches a method comprising: 
A) A computer readable storage medium embedded with a computer program 
for making a computer perform the method according to claim 21 (Page 575, 
Section B, Figures 5-6). 

The examiner notes that Kohonen teaches "A computer readable 
storage medium embedded with a computer program for making a 
computer perform the method according to claim 21" as "develop the final 
software for our method" (Page 575, Section B) and "our system operate in real 
time and fit medium-sized computers" (Page 575, Section B). 

Regarding claim 29, Kohonen teaches a interface comprising: 

A) a memory that stores a set of distinct information items (Page 575, Section B, 
Figures 5-6); and 

B) an information retrieval system in which a set of distinct information items are 
mapped to respective nodes in an array of nodes by mutual similarity of the 
information items, so that similar information items map to nodes at similar 
positions in the array of nodes (Page 574, Figures 5-6) 

C) a user control configured to define a first search criterion for selecting 
information items (Page 584, Figure 6); 

D) and a second search criterion, the second search criterion defining a subset 
of the array of nodes such that only information items that meet the first search 
criterion and are located in the subset of the array of nodes defined by the 
second search criterion are selected; 
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E) a graphical user interface having a display area arranged for displaying 
display points within a display area (Page 584, Figures 5-6); 

F) by grouping the display points in accordance with the positions of the nodes 
to which the selected information items have been mapped (Page 584, Figures 1 , 
4-6). 

The examiner notes that Kohonen teaches "a memory that stores a set 
of distinct information items" as "develop the final software for our method" 
(Page 575, Section B) and "our system operate in real time and fit medium-sized 
computers" (Page 575, Section B). The examiner further notes that Kohonen 
teaches "an information retrieval system in which a set of distinct 
information items are mapped to respective nodes in an array of nodes by 
mutual similarity of the information items, so that similar information items 
map to nodes at similar positions in the array of nodes" as "documents are 
presented as points on a two-dimensional (2-D) plane and the geometric 
relations of the image points of the documents represent their similarity relations" 
(Page 574). The examiner further notes that Kohonen teaches "a user control 
configured to define a first search criterion for selecting information items" 
as "keyword search" (Page 584). The examiner further notes that Figure 6 
describes an interface which displays retrieved search results based on the 
search constraint. The examiner further notes that Kohonen teaches "a 
graphical user interface having a display area arranged for displaying 
display points which are at positions within a display area corresponding 
to the selected information items" as the retrieved results depicted in Figure 6. 
The examiner further notes that Kohonen teaches "by grouping the display 
points in accordance with the positions of the nodes to which the selected 
information items have been mapped" as "Select labels automatically to 
characterize map regions" (Figure 1 , Step 3). The examiner further notes that 
the retrieved results depicted in Figures 5 and 6 clearly show positions of nodes 
retrieved from a query, and located in a defined region within the 2d map. The 
examiner further wishes to state that Figure 4 clearly shows the information items 
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mapped to respective regions designated by different categories (see Chemistry 
and Building). 

Kohonen does not explicitly teach: 
A) related to contents of items of video material; and 
G) the display area arranged to display in a sequence in time a plurality of 
representations of the selected information items. 

Derthick, however, teaches "related to contents of items of video 
material" as "video retrieval, our current interfaces segment video into shots, 
and represent them with single frames" (Page 1, Section 1, Figure 1) and "the 
graphical user interface also displaying in a sequence in time a plurality of 
representations of the selected information items" as "RSVP slideshow" 
(Page 1 , Section 2) and Figure 1 . 

The examiner notes that Figure 1 depicts an RSVP image show on an 
graphical user interface. 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because 
teaching Derthick's would have allowed Kohonen's to provide a method for 
having an efficient multiple image/multimedia retrieval based on RSVP premises, 
as noted by Derthick (Abstract). 

Kohonen and Derthick do not explicitly teach: 
D) and a second search criterion, the second search criterion defining a subset 
of the array of nodes such that only information items that meet the first search 
criterion and are located in the subset of the array of nodes defined by the 
second search criterion are selected. 

Schultz, however, teaches "and a second search criterion, the second 
search criterion defining a subset of the array of nodes such that only 
information items that meet the first search criterion and are located in the 
subset of the array of nodes defined by the second search criterion are 
selected" as "According to another aspect of the invention, geographically 
defined user queries may be composed by the client using textual information 
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and/or spatial search information. Spatial search information may be selected, 
e.g., by the user highlighting a desired point or area on a displayed map. A 
combination search including text and spatial information may also be used" 
(Paragraph 13). 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because 
teaching Schultz's would have allowed Kohonen's and Derhtick's to provide 
more specific results for search engines via user-defined parameters, as noted 
by Schultz (Paragraph 8). 

Regarding claim 30, Kohonen further teaches a interface comprising: 
A) wherein graphical user interface displays a two-dimensional display array of 
the display points (Page 574, Figures 5-6). 

The examiner notes that Kohonen teaches "wherein graphical user 
interface displays a two-dimensional display array of the display points" as 
"documents are presented as points on a two-dimensional (2-D) plane and the 
geometric relations of the image points of the documents represent their 
similarity relations" (Page 574). 

Regarding claim 31 , Kohonen does not explicitly teach a interface 
comprising: 

A) wherein the sequence in time is a serial visual presentation of the said 
representations. 

Derthick, however, teaches "wherein the said sequence in time is a 
serial visual presentation of the said representations" as "Rapid Serial Visual 
Presentation" (Page 1 , Abstract) and Figure 1 . 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because 
teaching Derthick's would have allowed Kohonen's to provide a method for 
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having an efficient multiple image/multimedia retrieval based on RSVP premises, 
as noted by Derthick (Abstract). 

Regarding claim 32, Kohonen does not explicitly teach a interface 
comprising: 

A) wherein the user control is further configured to select a representation from 
the plurality of representations, and the graphical user interface includes 
displaying information related to the selected representation. 

Derthick, however, teaches "wherein the user control is further 
configured to select a representation from the plurality of representations, 
and the graphical user interface includes displaying information related to 
the selected representation" as "Rapid Serial Visual Presentation" (Page 1 , 
Abstract), "large image grid was continuously visible for SD" (Page 1 , Section 2) 
and Figure 1. 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because 
teaching Derthick's would have allowed Kohonen's to provide a method for 
having an efficient multiple image/multimedia retrieval based on RSVP premises, 
as noted by Derthick (Abstract). 

Regarding claim 34, Kohonen does not explicitly teach a interface 
comprising: 

A) a presentation control configured to control the presentation of the sequence 
of representations. 

Derthick, however, teaches "a presentation control configured to 
control the presentation of the sequence of representations" as "very large 
scrollbar" (Page 1, Section 2, Figure 1) and "countdown timer" (Page 1, Section 
2, Figure 1). 
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It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because 
teaching Derthick's would have allowed Kohonen's to provide a method for 
having an efficient multiple image/multimedia retrieval based on RSVP premises, 
as noted by Derthick (Abstract). 

6. Claim 8 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Kohonen et al. (Article entitled "Self Organization of a Massive Document 
Collection") in view of Derthick (Article entitled "Interfaces for Palmtop Image 
Search") and in view of Schultz et al. (U.S. PGPUB 2003/0061 21 1 ) as applied to 
claims 1-7, 9-11, 14-25, 29-32, and 34, and further in view of Doerre et al. (U.S. 
Patent 6,446,061). 

7. Regarding claim 8, Kohonen, Derthick, and Schultz do not explicitly 
teach a video processing apparatus comprising: 

A) wherein the information items are pre-processed for mapping by excluding 
words occurring with more than a threshold frequency amongst the set of 
information items. 

Doerre, however, teaches "wherein the information items are pre- 
processed for mapping by excluding words occurring with more than a 
threshold frequency amongst the set of information items" as "a solution to 
this problem the invention suggests to use names, terms, and general words, but 
to apply filtering to remove high-frequency terms and very low-frequency terms" 
(Column 18, lines 45-51). 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because 
teaching Doerre's would have allowed Kohonen's, Derthick's, and Schultz's to 
provide a method to prevent cluster coherence at the expense of meaningful 
cluster descriptors, as noted by Doerre (Column 18, lines 41-44). 

8. Claims 12-13 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Kohonen et al. (Article entitled "Self Organization of a Massive Document 
Collection") in view of Derthick (Article entitled "Interfaces for Palmtop Image 
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Search") and in view of Schultz et al. (U.S. PGPUB 2003/0061 21 1 ) as applied to 
claims 1-7, 9-11, 14-25, 29-32, and 34, and further in view of Bruijn et al. (Article 
entitled "Patterns of Eye Gaze during Rapid Serial Visual Presentation"). 
9. Regarding claim 12, Kohonen, Derthick, and Schultz do not explicitly 
teach a video processing apparatus comprising: 

A) wherein the graphical user interface displays representations one at a time in 
sequence in the same display zone. 

Bruijn, however, teaches "wherein the graphical user interface 
displays representations one at a time in sequence in the same display 
zone" as "Keyhole RSVP" (Pages 1-2, Section I) and "We use the term Keyhole 
RSVP when all the images appear, in rapid sequence, in the same location at the 
same size" (Pages 1-2, Section I). 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because 
teaching Bruijn's would have allowed Kohonen's, Derthick's, and Schultz's to 
provide a method for multiple ways to express different RSVP configurations. 

Regarding claim 13, Kohonen and Derthick do not explicitly teach a 
video processing apparatus comprising: 

A) wherein the graphical user interface displays a plurality of said 
representations at the same time in respective display zones. 

Bruijn, however, teaches "wherein the graphical user interface 
displays a plurality of said representations at the same time in respective 
display zones" as "Collage RSVP" (Page 2, Section I) and "a set of images 
being deposited, in rapid sequence, on a table top in such a way that five or six 
are visible at any one time" (Page 2, Section I). 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine the teachings of the cited references because 
teaching Bruijn's would have allowed Kohonen's, Derthick's, and Schultz's to 
provide a method for multiple ways to express different RSVP configurations. 
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Response to Arguments 

1 0. Applicant's arguments filed 08/1 2/2008 have been fully considered but 
they are not persuasive. 

Applicants argue on page 3 that "Schultz does not teach or suggest a 
second search criterion as defined by Claim 1. Specifying a geographical 
area in Schultz is not a "second search criterion defining a subset of the 
array of nodes," because Schultz does not teach or suggest nodes, as 
defined by Claim 1, such that "similar information items map to nodes at 
similar positions in the array of nodes". However, the examiner wishes to 
state the primary reference of Kohonen teaches the claimed nodes (See 
"documents are presented as points on a two-dimensional (2-D) plane and the 
geometric relations of the image points of the documents represent their 
similarity relations)" and its aforementioned definition, and that the combination of 
Schultz with Derthick's invention allows for second searches to be combined 
with first searches on an array of nodes. Moreover, the examiner wishes to state 
that the aforementioned limitation merely states "a second search criterion, the 
second search criterion defining a subset of the array of nodes such that only 
information items that meet the first search criterion and are located in the subset 
of the array of nodes defined by the second search criterion are selected". The 
examiner further wishes to refer to Paragraph 13 of Schultz which states 
"According to another aspect of the invention, geographically defined user 
queries may be composed by the client using textual information and/or spatial 
search information. Spatial search information may be selected, e.g., by the user 
highlighting a desired point or area on a displayed map. A combination search 
including text and spatial information may also be used" (Paragraph 13). The 
examiner further wishes to state that the aforementioned limitation merely is 
interpreted to state that items that satisfy dual search criteria are selected. 
Because Schultz teaches that results that satisfy textual input (first search 
criteria) and spatial input (second search criteria), then as a result, the 
aforementioned limitation is taught. 
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Applicants argue on page 3 that "Nothing in Schultz teaches or 
suggest that businesses or other query items of a similar category are 
mapped to a similar area of the geographical map of Schultz such that a 
second search criterion defining a subset of the map area searches for 
businesses that meet the first search criterion, the query item, and are also 
located in the subset of the map area". However, the examiner further wishes 
to refer to Paragraph 13 of Schultz which states "According to another aspect of 
the invention, geographically defined user queries may be composed by the 
client using textual information and/or spatial search information. Spatial search 
information may be selected, e.g., by the user highlighting a desired point or area 
on a displayed map. A combination search including text and spatial information 
may also be used" (Paragraph 13). The examiner further wishes to state that 
because Kohonen teaches the claimed nodes and its specific definition, then as 
a result, applicants arguments are unfounded. Moreover, because the spatial 
search of Schultz limits the textual search to only items mapped via similarities 
(i.e. all businesses are shown via their geo-positional locations to one another), 
then as a result, the items are broadly mapped via similar category regardless. 

Applicants argue on page 3 that "In fact, such a suggestion would 
render Schultz inoperable for its intended purpose because recognizing 
businesses within the geographical area selected by the user would 
prevent the user from finding the correct geographical location of the query 
item". However, it contrast to applicant's suggestion that the combination of 
Kohonen and Schultz would render Schultz inoperable, the combination would 
not render Schultz inoperable. Because both Kohonen and Schultz deal with 
the scope of querying a database for search results, then as a result, they can be 
combined. 

Applicants argue on page 4 that "The outstanding Office Action also 
cites a paragraph of Schultz that merely states the advantages of providing 
the ability to specify geographic areas for search. However, these 
statements shed no light on why the outstanding Office Action would 
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assert that it would be obvious for one of ordinary skill in the art to 
combine an ability to specify a geographic search with self -organizing 
maps". However, In response to applicant's argument that there is no 
suggestion to combine the references, the examiner recognizes that obviousness 
can only be established by combining or modifying the teachings of the prior art 
to produce the claimed invention where there is some teaching, suggestion, or 
motivation to do so found either in the references themselves or in the knowledge 
generally available to one of ordinary skill in the art. See In re Fine, 837 
F.2d 1071, 5 USPQ2d 1596 (Fed. Cir. 1988) and In re Jones, 958 F.2d 347, 21 
USPQ2d 1941 (Fed. Cir. 1992). In this case, the cited motivation of "to provide 
more specific results for search engines via user-defined parameters" clearly 
provides motivation to combine the aforementioned references because of the 
ability to improve the search results of a user. Because both Kohonen and 
Schultz deal with the scope of querying a database for desired search results, 
then as a result, they can be combined. 

Conclusion 

1 1 . The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

U.S. PGPUB 2003/0208485 issued to Castellanos on 06 November 
2003. The subject matter disclosed therein is pertinent to that of claims 1-25 and 
29-34 (e.g., methods to use SOM mapping). 

U.S. Patent 7,017,186 issued to Day on 21 March 2006. The subject 
matter disclosed therein is pertinent to that of claims 1-25 and 29-34 (e.g., 
methods to use SOM mapping). 

U.S. PGPUB 2005/0027704 issued to Hammond et al. on 03 February 
2005. The subject matter disclosed therein is pertinent to that of claims 1-25 and 
29-34 (e.g., methods to use preprocess words from documents). 

U.S. Patent 5,864846 issued to Voorhees et al. on 26 January 1999. The 
subject matter disclosed therein is pertinent to that of claims 1-25 and 29-34 
(e.g., methods to use preprocess words from documents). 
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U.S. PGPUB 2003/0217335 issued to Chung et al. on 20 November 
2003. The subject matter disclosed therein is pertinent to that of claims 1-25 and 
29-34 (e.g., methods to use SOM mapping). 

U.S. Patent 7,031 ,909 issued to Mao et al. on 18 April 2006. The subject 
matter disclosed therein is pertinent to that of claims 1-25 and 29-34 (e.g., 
methods to use SOM mapping). 

U.S. PGPUB 2004/0107221 issued to Trepess et al. on 03 June 2004. 
The subject matter disclosed therein is pertinent to that of claims 1-25 and 29-34 
(e.g., methods to use SOM mapping). 

U.S. PGPUB 2004/0056886 issued to Trepess et al. on 25 March 2004. 
The subject matter disclosed therein is pertinent to that of claims 1-25 and 29-34 
(e.g., methods to use SOM mapping). 

U.S. PGPUB 2004/0107194 issued to Thorpe on 03 June 2004. The 
subject matter disclosed therein is pertinent to that of claims 1-25 and 29-34 
(e.g., methods to use SOM mapping). 

U.S. PGPUB 2004/0130569 issued to Thorpe on 08 July 2004. The 
subject matter disclosed therein is pertinent to that of claims 1-25 and 29-34 
(e.g., methods to use SOM mapping). 

U.S. PGPUB 2004/0139105 issued to Trepess et al. on 15 July 2004. 
The subject matter disclosed therein is pertinent to that of claims 1-25 and 29-34 
(e.g., methods to use SOM mapping). 

U.S. PGPUB 2006/0095852 issued to Trepess et al. on 04 May 2006. 
The subject matter disclosed therein is pertinent to that of claims 1-25 and 29-34 
(e.g., methods to use SOM mapping). 

Article entitled "Analysis of Processes and Large Data Sets by a Self- 
Organizing Method" by Kohonen, dated 1999. The subject matter disclosed 
therein is pertinent to that of claims 1-25 and 29-34 (e.g., methods to use SOM 
mapping). 
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Article entitled "A Self-organizing Semantic Map for Information Retrieval" 
by Lin, dated 07 July 1997. The subject matter disclosed therein is pertinent to 
that of claims 1-25 and 29-34 (e.g., methods to use SOM mapping). 

12. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of 
time policy as set forth in 37 CFR 1 .1 36(a). 

A shortened statutory period for reply to this final action is set to expire 
THREE MONTHS from the mailing date of this action. In the event a first reply is 
filed within TWO MONTHS of the mailing date of this final action and the advisory 
action is not mailed until after the end of the THREE-MONTH shortened statutory 
period, then the shortened statutory period will expire on the date the advisory 
action is mailed, and any extension fee pursuant to 37 CFR 1.136(a) will be 
calculated from the mailing date of the advisory action. In no event, however, will 
the statutory period for reply expire later than SIX MONTHS from the mailing 
date of this final action. 

Contact Information 

1 3. Any inquiry concerning this communication or earlier communications from 
the examiner should be directed to Mahesh Dwivedi whose telephone number is 
(571 ) 272-2731 . The examiner can normally be reached on Monday to Friday 
8:20 am -4:40 pm. 

If attempts to reach the examiner by telephone are unsuccessful, the 
examiner's supervisor, Tim Vo can be reached (571) 272-3642. The fax number 
for the organization where this application or proceeding is assigned is (571) 
273-8300. 

Information regarding the status of an application may be obtained from 
the Patent Application Information Retrieval (PAIR) system. Status information 
for published applications may be obtained from either Private PAIR or Public 
PAIR. Status information for unpublished applications is available through 
Private PAIR only. For more information about the PAIR system, see http://pair- 
direct.uspto.gov. Should you have questions on access to the Private PAIR 
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system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll- 
free). 

Mahesh Dwivedi 
Patent Examiner 
Art Unit 2168 

November 17, 2008 
/Mahesh H Dwivedi/ 
Examiner, Art Unit 2168 

/Tim T. Vo/ 

Supervisory Patent Examiner, Art Unit 2168 



